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Random processes wish stationary nth differences serve as models for oscillator phase 
noise. The theorem proved here allows one to obtain the structure function (covariances 
of the nth differences) of such a process m terms of the diff fences of a single function of 
one time varhHe, In tum^ this function can easily be obtained from the spectral density 
of the process. The theorem is used for computing the variance of two estimators of 
frequency stability. 


I. Introduction 

Let the output of a precision oscillator be modelled by cos 
{2jri'Q(f + x(t)] } , where x{t) is a random process representing 
the ‘^phase time"" noise. The most widely used time-domain 
measure of oscillator stability is the Allan variance, defined by 
the ensemble average 

aj(r) = — L £'(aJj:(s)J , (1) 

2r^ 

provided that the expectation exists and is independent of the 
times. Here, L the backward 2nd difference operator, 
given by 

^IfU) = /(/)- 2fU- T)*fU- 2r). 

The theorem given here arose froir. the desire to compute 
the performance of estimators of o^(r). Suppose that jr(r)is 
given on an interval 0 < r < T. Fix r < /'/2, and set 

f(7) - — 
ts/2 


A class of unbiased estimators of <^(t) is given by 

V- reit)w{t)dt, ( 2 ) 

Jjt 


where w(r) is a weighting function (or measure) whose total 
weight on (2r, T) is 1 . Two members of this class are treated 
in Section IV. 

Assume further that is a stationary Gaussian process 
with zero mean and autocovariance function Then iHt) 
is a stationary process with mean <^(^) 3nd autocovariance 
function 2/^^(f). It follows that 

EV = EiHo = oliT), 


VarK= I I 2R\{s- t)wU)w{t)dsdt . (3) 

JlT Jlr 
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Evidently, to compute Var K, we need to obtain 
from the model forx(r). Let us suppose, temporarily, thatx(f) 
is stationary, with autocovarianoe fimction 

R^iO - Cov[jrfs + /),jr(s)l, 

not depending on s. A straightforward computation yields 
£Ajjr(s) = 0, and 

EAlx(s + r)A*ac(s) = (4) 


For modelling oscillator phase noise. It is usually sufBdeiit 
to let jc(t) beltmg to the class of proo^es uimse 2nd diti'er* 
enc^ A^x(r) are stationary. Th^> class includes the stationary 
processes and those with stationary 1st differences. Such a 
process has a two-sided formal** spectral (tensity 
which can have a singularity at <o = 0 that is strmig enou^ to 
make 


= «>. 



where 6^ = central 4th difference operator, also Nevertheless, we always have 

given by 


«;/(0 = At - 2 t ) - m - r) + 6At) - 4At * r) +/(f + 2r). 


/ *" 4 

— ^ — S (o})du) < 


(7) 


The left side of (4) is called the 2nd structure function ofx(r) 
(Refs. 1 , 2). Letting f = 0 in (4), we have 


aj(r) = 4 

as pointed out by Barnes (Ref. 3). Consequently, since 
</?j,(0) = Varx, 


aj(r)< 


8 Varx 


for this class of processes. An examjde is the power-law 
spectrum 


= 


K 


where 1 <p< 5. 

A rigorous theory of th^ processes exists (Ref. 1); basi- 
cally, it shows that one can plunge ahead with the formalism 
from stationary processes as long as the integrals conveige. For 
example, the transfer function of the operator is 
(1 - Therefore, 


2 . V 3 Varx . . ... 

oUr) ^ — (t «>), (6) 

provided /?^(i ) -► 0 (f -► ®®). 

This is for stationary jc(/). On the other hand, for actual 
oscillators a behavior like (6) is observed only for s^U r, 
below 1 s for quartz cr>stal oscillators and 100 s for hydrogen 
maseis. As r increases, the measured Oj^{r) decreases to a 
minimum, then stays constant or increases. Of course, since 
our measurement times are finite, this observation does not 
“prove” that x(r) is nonstationary. A stationary process with a 
huge variance and a tiny bandwidth would explain what we 
see. for we would be looking onlv at a small piece of the 
process. If t were to increase beyond the scale of our observa- 
tions. then o^(r) would ultimately behave like (6) again. 
However, if we want to describe the behavior of jr(/) on 
realistic time intervals, a nonobservable low-frequency cutoff 
only gets in the way. and eventually has to be driven to zero. 
It is mathematically easier to use a nonstationary model from 
the very start. 


£A^x(f + s)A^x(s) 



^r|, . 




( 8 ) 


The extra term comes from a frequency drift component 
cf^/2 in xtf). Letting / = 0, we obtain the Allan variance (I). 
By this method, the theoretical Allan variance has been evalu- 
ated and tabulated (Ref. 4) for5j^(cu)- A/icj|*, k an integer, 
0 < k < 4. (For ^ < 1 , a high-frequency cutoff is provided.) 
Allowing / to be nonzero appears to make (8) more difficult to 
evaluate. Yet. for our estimation problem, we do need the full 
covariance function of the process A^jr(/)- One longs for the 
simplicity of (4), with RjfU) pven by the simple Fourier 
integral 


R (0 = 

jf' ' 





( 9 ) 
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This integral does not exist* however, unless x{t) is stationary 
(or equal to a quadratic polynomial phis a stationary process). 

The theorem to be proved here gives an easily computable 
repkcen^t for valid for all processes with stationary 
differences. Equation (4) is replaced by 


+ f)Ajx(s) = 6^ [2 Re C(f)] + (10) 


where the (nonunique) function C(f) can be computed by two 
different methods. Here is the second method: Choose an 
integer k such that is integrable near cj * 0. Then let 


ar) = /* / e^(iw)*s,(w)^ (11) 

in the upper half-plane Im z > 0. The operator/* instructs the 
user to integrate k times with respect to z. One may then allow 
z to be real. 

Formally, all w^ are doing is differentiating (9) k times and 
integrating k times. It one does this correctly, one easily gets 
valid results for aD the power-law oscillator noise models. 
Although Lindsey and Chie (Ref. 2) give a number of formulas 
that generalize (5), they have to assume that either the ptme 
x(r) or the frequency dx/dt is stationary. For flicker FM or 
random walk FM noise, these assumptions are false. Lindsey 
and Chie do hint at the need for distribution theory in this 
situation. Although our method has obvious connections to 
the analytic representation of distributions (Ref. 5), we use 
only the elementary theory of real and analytic functions to 
arrive at the main result. 


2Re 0(f) 


0 (f>0) 

(t<0) . 


( 12 ) 


This fiinctkn is nothing like the autocovarianoe function of a 
stationary {vocess, yet applying the opeiatw 6^ to it ghm the 
result 

E^s + f) «J) - -L «^(2 Re C(0) 

2t* ' 


ifr 

12 


! (2-r)^-4(l-r)^ (0<r<l) 
(2-r)’ (Kr<2) 

0 (r>2) 


(13) 

(where r « If l/r), wb*ch is a perfectly ^>od autocovarianoe func> 
tion. In {mticuiar. 


olir) = £|V) * f . 

The result (13) can also be derived by expressing ^f) as the 
output of a fSter acting on udute noise. The method given here 
is easier and applies to more general difference operators. 
Moreover, as Section III shows, all of the power-law spectral 
models become equally simple. Previously, the odd powers 
(the ^flicker’* models) were more difficult to handle than the 
even powers. 


To illustrate the theorem, let us consider tne noise caUed 
random walk frequency modulation^ defiried by 
AT/u)^. For this noise, o\{r) is proportional to r (as we shall 
soon see); this kind of Allan variance behavior has been ob- 
served in hydrogen maser frequency standards for r> lO^s 
(Ref. 6). Taking k = 4 in (1 1), wc have 


II. The Re pr e sen tat io n Theorem 

A mean-continuous random procra x(t) is said to have 
statwnary diffmnees if, for each real r, the process 
A^x(t) is stationary (in the wide sense). For such a prucess, 
define the dc coefficient c by 

c ■ lim 1 r ^1x(t)dt 

7w« u/o 


ifi z^ In z ^ 

■T.— 

in which In z is to be analytic in !mz>0. The function 
(z^ In z)/6 is just a particular solution to the equation * 
1/z. Taking In z = In Izl ^ i Arg z in the upper half-plane, we 
get 


(in mean square). 

For applications, we shall assume that the rt^ difference' 
of x(/) are ergodic, so that c is nonrandom. It can then be 
shown that 

cr^ * £A;jc(f). (14) 
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The process x^it) = x(t) - ct"ln\ equals a polynomial of 
degree <n plus a mean-zero process. Associated with x^it) is a 
(two-sided) nonnegative formal spectral density from 

whidi all the covariances of the n^ differences of x(r) can be 
obtained. If x(t) is real, then S^(-to) * 

In connection with these processes, it is convenient to 
inircduce a general real difference operator L that, when 
applied to a function /(t), gives the result 

05) 

V 

(a finite sum), where the are real. Its transfer funcdcm is the 
trigonometric polynomial 

f-O'w) = . 

V 

For example, 

= (i - f^)" 

A difference operator L is said to have order n if its transfer 
function satisfies 

if/)(0) = “ 0 (0 </•<«) . 


L and M have orders / and m, and A » ZJIf, then A has order 
Hm, and 

(0) i(0 (0) 3#<«) (0) 

(/ + !«)! “ /! «! ' ^ 

If I. is given by (IS), then the operator L'‘ (of the same order) 
is defined by 

iV(o = Evo-'p)- 

V 

As we mentioned, an example of order it is Z* - A”, for 
which Anotht^r example, for it -2, is the 

mixed difference operator A^A^s which was used for estimat* 
ing the relative drift rate of a pair of frequency standards 
(Ref. 7). 

We are now set up to give the main result. 

Theorem. Let x(f) be a real process with stationary nth 
differences, nonrandom dc coefficient c, and spectral density 
Let L and M be real difference operators of order n, 
and let A be the difference operator LM* of order 2it. Then, 
the mixed second moments of the processes Lx{t) and Mx(t) 
can be put into the form 

ELx{s + t)Mx{s) = A [(-1)" ^ + 2 Re C(o] , 

(18) 

where the (nonunique) function C(z) is analytic in Im z > 0, 
continuous in Im z > 0, and can be obtained by either of the 
following recipes: 


/,(")(0) » 2 0 • 
V 


Such an operator annihilates all polynomials of degree Ot, and 
reduces the degree of other polynomials by n, as shown by the 
computation 

V V ;=0 


(16) 


rri — 

= E (r)i^H0)r^-' = £(pi<^>(0)f 




/=0 




Recipe 1. Choose an integer k between 0 and 2n such diat 


J cj* *yj^(w) dtj < oo , 


Let C(z) = Cq(z), where 




(Im z > 0). 


( 19 ) 


(Recall that (^) = 0 for / >m.) In particular, Lr" If If A: = 0. then omit the sum. 
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Recipe 2. Gioose it as in Recipe 1 . Defme 


B{i) = I e'"* (M* S^(«) ^ Om 2 >0). (20) 

Jo 

Let C( 2 ) be any A;th integral of R(z) on Im z > 0 (in other 
words, any function such that ~ ^2))- Extend C(r) to 

the real line by continuity. (This is always possible.) 

Remark. The first term in the brackets in (18). when icted 
upon by A, becomes 

^2 ^ ^ ^ ^21) 

Corollary, Let x(t) have stationary nth differences. The 
structure function 

Z>(r, r) = £A"x(s + r) A"jc(s) 

of the process x{t) can be obtained from a function of one 
variable, namely 2 Re C(0» by 

D(t: r) = + (- ir 6j«(2 Re C{r)), (22) 


are the sharp cutoff (1 for |cj| < 0 elsewl^re) and die 

exponential cutoff exp(- |co|/«Oj^). The above noises are called 
random walk FM^ flicker white FM, flicker and white 
PM, (The terra ‘Vhite** will be used even if F is not exactly 
flat near zero frequency.) 

The introduction has diown how to apply the representa- 
tion theorem to random walk FM; let us proceed to the 
calculation of 2 Re C{t) for the other noises. In order to 
express the results in the established notation of the frequency 
and timing L;erature (Ref. 4)» we use the form 

A 

5,(W) « KJiar^ . iC„ * -2-. (23) 


where a high-frequency cutoff F(uj/cJ|^) is also applied when 
a > 1 (PM noises). 

First, let a * 0, - 1, or -2 (white, flicker, or random walk 
FM). Using Recipe 2 of the theorem with k « 2 - a, we have 

(24) 

Since a kth integral of 1 /r is (r*”* In z)/(k - 1)!, we get 


where 


6j» = (6*)" = (- V./, 


j-A+1 

C( 2 ) In r (lmz>0). (25) 


the central difference operator of order 2n, 

These results show tnat 2 Re C(r) contains the same infor- 
mation as about the process x{t). We can regard 2 Re 

CT/) as an analog of the covariance function of a stationary 
process. 


III. Example8forn = 2 

Oscillator phase noise is often modelled by a linear com- 
bination of independent power-la »v noises with spectra 


1 


CO 


4 



I f(u;/co^) 

'J'' 




where f(to/co^) is an inlegiable low-pass power response func- 
tion whose one-sided noise bandwidth is u)J{2n). Examples 


in which the branch of In z must be analytic in the upper 
half-plane. We shall let In t be real for r > 0. Let us examine 
the three cases separately. 

White FM: a = 0,A: = 2. 

C(z)»2^zlnz. 


C(0 


2 Re C(i) 


V 

2x1 


Inr (r>0) 

Inlrl+OT C'<0), 

jo (/>0) 


(26) 
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K. 

C(z) “ — — z* In 2 , 


2ReC(0 


8ir^(l+w*f*) ’ 


which is just because now x(0 is stationary. 


(31) 


2ReC(0 = ^ r^ Inirl. (27) 


Random walk FM. a = -2,i = 4. 

K J 

T'"'’ 

/. „2 (0 (r>0) 

2ReC(r)=— V*{ (28) 

" {-t^ it<0). 

In a sense, the flicker ca&e is easier than the others because 
we don't have to keep track of the imaginary part of In z. 

For handling the PM noises, tl^e exponential cutoff is easier 
to use than the sharp cutoff, and may even be more realistic. 
Let exp( IcjI/cJ;,), where a = 1 or 2. Again 

letting k = 2 - a, we get 


Fractional noises. It is weU known (Ref. 4) that the 
spectrum satisfies a power law5j^(co) where -3 

< or < I , then the Allan variance sattfies another power law 
oj (r) = const • r**, where /i = - 1 -a. When Allan variance 
measurements are made, fractional values of fjt sometimes 
appear over a certain range of r. Thus, we ought to show how 
to use the representation theorem for fractional values of a in 
the range --3 < a < 1. We ^all do this for 0 < a < 1, leaving 
the other cases as an exercise for the reader. Take k « 1. Then 

B(z) = ^1 
•'o 

_ r(g) 

{~izf ' 

r K r(a) 

C(.) = /J/Kz).(-£z) = -3^(-ir)-. 


B{z) 


K / 

a 


k*l 


z + i/w. 


Flicker PM : a=l,k=l. 


(29) 


where the power functions are analytic in the right half-plane 
and positive on the positive real axis. Then 


F(a) sin ( ^ to) 

2ReC(r) = = (32) 

(2n)'""(l-a) 


C(r) = - ^ ln(r + //w ), 
2;r ” 


As a 0, this expression tends to -k^j|rl/4, which is indeed a 
valid representative of 2 Re C(r) for ot = 0. 


2 Re C(f) = ^ In + I /wj) . (30) 

8»r^ 

For the sharp high-frequency cutoff, 2 ReC(f) turns out to be 
j cosine integral 

White PM Q = 2,k = 0, 


IV. The Variance of Two Allan 
Variance Estimators 

Let us return to the estimation problem mentioned in the 
introduction. Recall that phase time jc(r) is given for 0 < r 
Therefore, {(/) = A^jc(f)/(r\/2) is available for 2r < f 
< r. Set m = r/r. Two unbiased estimators of the Allan 
variance ( 1 ) are 


Ciz) = Biz) = ~ ^ 

2jt r + i/cj 


I 


V 


1 

m- 1 


E evr) 


h2 


(33) 
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(m an integer > 2), caUed the r-overlap estimator, and 

1 

^0 “ «*( 0 * ( 34 > 


were computed numerically; the others are in closed f<Mm, 
which, however, we shall not give here. For white PM and 
random walk Bl, the r*overlap formulas agree with those of 
Lesage and Audoin (Ref. 9); for flicker FM, the r-overlap 
numbers agree with Yoshimura’s (Ref. 10). 


(m real, >2), called the continuous estimator, which, although 
it cannot be achieved in practice, represents a limiting case for 
a sample time much less than r. The use of such an 
estimator was suggested by Ho*^ c. Allan, and Barnes (Ref. 8). 

Although the r-overlap estimrun has been used for many 
years, it is reasonable to ask whether the continuous estimator 
has a smaller variance. In other words, il' r^ « r, should we 
average ail the available samples (^(/r^), or should we use only 
the samples $^(fr)? Since the data collection time T may be 
weeks or months, this question is more than academic. 

The answer depends both on m and on the spectrum of the 
phase noise. Assume that x{t) is a Gaussian process with 
stationary 2nd differences and zero dc component c. If we 
know <Sy(iu), then we can compute C(z). By the corollary, the 
autocovariance function of the mean-zero process $(r) is 


The results are presented in terms of “degrees of freedom,* 
defined for a positive estimator Kby 


d.f. 


VarK • 


Given d.f., one sometimes uses the appropriate chi-squared 
distribution for constructing confidence intervals about the 
estimate (Ref. 8). Whether or not this is done, the d.f. remains 
a useful figure of merit. 

In Fig. 1, for the above Uire. noise types, we plot d.f./ 
(m- 1) vs « for and V^. For white FM, is always better 
than V^. For flicker FM, is better than except for 
m < 3. For random walk FM, is better tlian Fg for m < 18. 
Of course, the smaller values of m ate more critical, since d.f. 
is rou^y proportional tom - 1 . 


(2ReC(r)). (35) 

* 2t^ 

As we said in the introduction, the autocovariance function of 
the stationary process is 2R|(r). The means and variances 

of and are now computed straightforwardly: 

=R^(0) . a*(T), (36) 


Var = -L- T (m-1- |/|)/?* (/>) , (37) 
(m-D* ^ 


VarF^=-^ f ' (r,-ltl)Rj(t)dr, (38) 
^2 


where Tj = (m - 2 )t, (Of course, we recognize that is an 
even function.) 

The computations have been carried out for white FM, 
flicker FM, and random walk FM (see Section 111), ail of which 
have been observed in actual oscillators. The flicker FM results 


It may seem paradoxical for F, to be better than Fg, since 
Fg uses all the available data. Both estimators are special cases 
of (2), however; if one looks for the optimal (minimal vari- 
ance) estimator o^ the class (2) (for a given noise type), one 
will probably find that the optimal weighting function w(t) is 
noncoiistant and almost everywhere nonzero. In other words, 
one should use aH the data, but in a nonunifoim way. 

V. Concluding Summary 

Oscillator Stability is usually characterized by the behavior 
of nth order differences of the phase. The theoretical evalua- 
tion, from die phase noise spectrum, of the variam'es and 
covariances of these differences involves messy trigonometric 
integrals, such as (9). The messiness is caused by a (2/f)th order 
difference operator tangled up inside the integral. Our repre- 
sentation theorem breaks the integral evaluation into two easy 
steps. (1) evaluation of a much simpler integral depending 
only on the noise spectrum; (2) application of that same 
difference operator to the result of step (1). 

In effec., the evaluation of these integrals is uncoupled into 
two independent operations. In Section III, we tabulated only 
the result of step (I) (the function called 2 ReC(r)) for all the 
usual power-law oscillator noise models. This short **one- 
dimensionaP table, plus another one-dimensional table of dif- 
ference operators, can generate a two-dimensional table of 
results as found, for example, in Ref. 4. 
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As an application, we examined two Allan variance esti* 
mators Because the iV|/resentation theorem delivers such 
simple closed forms for the required autocovarianoe functions, 
rhe computations were quickly executed by a sample BASIC 
program. The theorem can Jso be used for evaluating the 


performance of frequency drift estimators. In general, we get 
an estimator of frequency drift rate (the dc coefFident c) by 
operating upon oscillator phase with a second-order difference 
ope’^utioK L that need not be of form aJ. Heiv, the fuB 
generality of the theorem is needed. 
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Appemfix 


For ccmvenieiiGe» let !ss first set down an elerocntary esti- 
mate of the Taylor reminder for e': It Re r < 0, it > 1» dien 


i 


e-«“w*S^(w)dw<~, 


*-i j 

'■ e 4 



(Al) ^ functioa fi(z) iA Reekie 2 exists and is ana^rtfe in 
lmz>0. Let usnowkx>katC 0 (z)asgivenhiRedpe Lit wiD 
so(Hi be du>wn that 


This can be obtained from the integral femn of the lemaincfer. 

In analogy with the usual notatioii for mixed structure 
functions €{t\ , r^) (Ref. 1)» denote the left side of (18) by 

D(t; L, M). Without loss of ^neraHty, we can assume that the 
dc coefficient c is zero. Begin with the spectral repres^tation 
of D(r;L,Af) as given by Yagloir.: 

• f' 


(a) C^Cz) is contkiwNis <n ha ..>0 and malytic on 
lmz>0; 

0 >) Cj*>(z) = J(z) for Im z > 0 ; 

(c) ACo(z)»^(z)forImz>0. 

Asssming (a) • (c), we see that Cq(z) is a mtegral of B(z) 
on bn z > 0 ; any udier inte^ G[z) diffeis from Cq(z) by 
at most a potyncmial of c^ree < A. &we A anoihtoes d 
polynomials of degree < 2 n, properties (a) • (c) hoM with 
Cq(z) replaced by C(z), and th: theorem foOows from (A2). 

To prove (a) • (c) denoted the bradeeted ejqMessitm in (19) 
by £(z, u>), which s{dits into the two parts 


= 2Re/ttr) . 


where 


A{z) = 





(A2) 


(A3) 


for z = r + iu (ii > 0), and A operates on functions of t. The 
name of the game is pulling A outside the integral. If you do 
this brutally, the integral usually blows up. 


£j(.' u;) 



2i« 

w 

_ ■ 

1 + w*" 


Accordingly, Cq(z) splits into two integrals C|(z) and C 2 (z). 
Since C 2 (z) is the Fourkr transform of an integrabk function, 
C^(zi is continuous on Im z > 0 ; on Im z > 0 it is analytic and 
can be differentiated repeatedly under the integral sign. 


Since the spectral density always satisfies 



S {u))dijj<°° 


Differentiating E^ repeatedly and applying (AI), we get the 
bound 


— £,(r, 

dzP ' 


1 g*-P M* 


(A4) 


(Ref. I), the integer k specified in Recipe 1 exists. Wc can 
alwa>:i take 1 : = 2 n; it is often possible and desirable to use a 
smaller k. If k-0 woiks, then S^(u)) is iniegrablc, A comes 
outside the integral in (A3), and we are done. In this case. 
Clz) * A(z), and ,tt/) is a polynominal plu.s a stationary process 
whose aul(Kovanance funct:on is 2 Re Qt), 

Assume k ^ \ . Smec. for .^1! w > 0. 


valid for 0 < p < Im z > 0, Iz K a. The right side of (A4) 
times *S^(u;) is integrable. Therefore, the function C|(z), on 
the domain Im z > 0 . can be differentiated k timee under the 
integral sign. In particular, C^{z) is continuous on tnis domain. 
This proves (a), and shows that Cq( 2 ) can be differentiated k 
times under the integral sign on Im z > 0 . Doing so gives (b). 
Property (c) is true because A annihilates polynomials of 
degree k - \. The theorem is proved. 
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